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We introduce a Random Energy Model on a hierarchical lattice where the interaction strength 
between variables is a decreasing function of their mutual hierarchical distance, making it a non- 
mean field model. Through small coupling series expansion and a direct numerical solution of the 
model, we provide evidence for a spin glass condensation transition similar to the one occurring in 
the usual mean field Random Energy Model. At variance with mean field, the high temperature 
branch of the free-energy is non-analytic at the transition point. 
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Clarifying the nature of glassy states is a fun- 
damental goal of modern statistical physics. Both 
for spin glasses fl] and for structural glasses 0, 
the mean field theory of disordered systems pro- 
vides a suggestive picture of laboratory glassy phe- 
nomena as the reflection of an ideal thermodynamic 
phase transition. Unfortunately, the development of 
a first principles theory of glassy systems going be- 
yond mean field, has resisted decades of intense re- 
search [3|-[5| . One of the main obstacles towards this 
goal, lies in the lack of reliable real space renormal- 
ization group (RG) schemes allowing to reduce the 
effective number of degrees of freedom and identify 
the relevant fixed points describing glassy phases. In 
ferromagnetic systems an important role in the un- 
derstanding of the real space RG transformation has 
been played by spin systems withpower law interac- 
tions on hierarchical lattices [a, 111- In these models 
the RG equations take the simple form of non-linear 
integral equations for an unknown function (as op- 
posed to the functional of statistical field theory), 
that can be solved with high precision. In this per- 
spective it is natural to generalize these models to 
spin glasses jU. 

In this letter, we introduce the simplest such spin 
glass model, a random energy model (REM) (l3. 14|. 
As we shall see, the hierarchical REM is such that the 
interaction energy between subsystems scales subex- 
tensively in the system size. It thus qualifies as a 
non-mean-field model. We report in what follows the 
results of a small coupling expansion and of an algo- 
rithmic solution of the RG equations for the entropy 
that, exploring complementary regions of parameter 
space, provide the first analytic evidence in favor of 
an ideal glass transition in a non mean-field model. 
Interestingly, this transition turns out to have -as in 
the case of the standard REM- the character of an 
entropy catastrophe analogous to the one hypothe- 



sized long ago for the structural glasses [IB], 

The hierarchical REM can be defined as a sys- 
tem of N = 2 k Ising spins with an energy function 
defined recursively. The recursion is started at the 
level of a single spin k = 0, with the definition of 
Hq[S] = ea(S), where the single spin energies are 
independent identically distributed (i.i.d.) random 
variables extracted from a distribution fJ-o(e). At 
the level k + 1, we consider then two independent 
systems of 2 k spins Si — {Su}, i — 1,...,2 and 
S*2 = {S2i}, i = 1, ... ,2 with Hamiltonians Hik [Si] 
and H 2 k [S 2 ] respectively and put them in interac- 
tion to form a composite system of 2 k+1 spins and 
Hamiltonian 

Hk+i [Si, S2] = Hik [Si] + H 2 k [S2} + £fc [Si, s 2 ] , 

where the are i.i.d. random variables extracted 
from a distribution fik+iit), chosen to have zero 

mean and variance (e k [Si, S 2 ] 2 ^ - 2^ k+1 ^ 1 -' J \ The 

interaction term e k [Si, S 2 ] is physically analogous to 
a surface interaction energy between the two subsys- 
tems. For a £ (0, 1) this model qualifies as a non 
mean-field system, where the interaction energy be- 
tween different parts of the system scales with vol- 
ume to a power smaller than unity. On the contrary, 
when er < the interaction energy grows faster than 
the volume. A rescaling of the energy is then neces- 
sary to get a well defined thermodynamic limit. The 
system behaves in this case as a mean-field model. 
Finally, for a > 1 the interaction energy decreases 
with distance and asymptotically the model behaves 
as a free system. In the following we focus on the 
most interesting region < a < 1. 

We have studied this model with two different 
methods. The first one is a replica study of the 
quenched free-energy, performed through a small 
coupling perturbative expansion. The second one is 



a numerical estimate of the microcanonical entropy 
as a function of the energy. Both methods suggest 
that a REM-like finite-temperature phase transition 
occurs for all a £ (0, 1). 

Perturbative computation of the free- energy- In or- 
der to make the calculations as simple as possible, we 
have chosen a Gaussian distribution for the energies 

We then considered the perturbative expansion in 
g = 2 x ~ a of the free-energy f(T) = /( ro )(T) + 
0(g m+1 ). Notice that the expansion of / to the ru- 
th order takes into account just the interactions with 
range less or equal to 2 m , i. e. the first m hierarchi- 
cal levels. 

The computation of the free-energy has been done 
with the replica method. In this context it is just a 
mathematical tool to organize the terms of the se- 
ries. We considered then the expansion of the av- 
erage partition function of the system replicated n 
times 



Z n = 



E 



exp 



3=0 



= 1 a,b=l 



where j3 = 1/T, and is the configuration of the 
i-th group of spins at the j/'-th level of the hierarchy. 
This representation allowed an automated computa- 
tion of f( m ^ up to the value of m = 10. 

A useful check of the method is obtained consid- 
ering a < 0. Since in this case high values of j dom- 
inate the energy in (jTJ) , correlations between the en- 
ergy levels can be neglected. After rescaling the ener- 
gies by ej — > 2 ka l 2 ej the free-energy of the model be- 



comes equal to the one of the standard REM (lH.[li| 
with critical temperature T c — ^J^2j 2~^~/ log 2. We 

found that, when increasing m, /( m J converges to 
the REM free-energy with exponential speed in the 
whole high temperature regime /3 < f3 c . 

We now consider f(T) for < a < 1. The direct 
inspection of the curves shows that, for m > 1, the 
m-th order entropy S ( m )(T) = -df ( m )(T)/c£T while 
positive at high temperature, becomes negative at 
some temperature Tc\ As can be seen in fig. [TJ 
the sequence T c (m) exhibits a good exponential con- 
vergence to a finite limit T c for a < 0.15. The sta- 
bility of these data for large m clearly suggests that 
an entropy crisis transition is present in the model 
at T c . The inset in fig. (fl]) shows that T c is a de- 
creasing function of er, consistently with the fact that 
the larger cr, the weaker the interaction strength. At 
high temperature also the free-energy series has a 
good exponential convergence in g (see fig. [5]). 



This small g expansion gives some evidence for 
an entropy crisis taking place at temperature T c . It 
is important to realize that this T c cannot be sim- 
ply computed from the sum of the variances of the 
££,: the energy correlations cannot be neglected. An 
entropy crisis implies the existence of a phase tran- 
sition at a temperature > T c . In a REM scenario, 
the phase transition would take place exactly at T c , 
when the entropy vanishes. An argument in favour 
of such a result can be found with a one-step replica 
symmetry breaking Ansatz. Consider the partition 
function (fTJ) and suppose that the n replicas are 
grouped into n/x groups, so that, for any two repli- 
cas a, b in the same group, Sa — sjf'^ for all i,j. 
Then perform again the small g expansion, within 
this Ansatz. To each order m, this procedure gives 
a free-energy fi" l \T) = /( m ) (T '/ 'x). The maximiza- 
tion over x then gives x = 1 for T > Tc ,n \ and 
x = T/T^ m) for T < T c (m) . This result is in com- 
plete analogy with the one found in the REM, so the 
above replica symmetry breaking Ansatz predicts a 
REM-like transition at T = T c . In order to get a dis- 
tinct evidence for this scenario, we have done some 
numerical study. 
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FIG. 1: The temperatures vs m for a — .1. Here 

T c = 1.861 ± .021. Inset: T c vs a. 

Numerical computation of the entropy- We exploit 
the hierarchical structure of the model to compute 
the microcanonical entropy Sk(E). In order to make 
the computations as simple as possible, we have 
chosen for /Xfc(e) the Binomial distribution 171 Il8l|: 

Mfe( e ) = owri , , M k )■ At the level k, M k is the 



Mis. 

2 



integer part of ^2 k ^ a \ to have the same scaling of 
the variance as in the Gaussian model. The constant 
7 is chosen so that for all the values of a studied, 
L( 7 2 fc ( 1 -°-))J/(72 fc ( 1 - ff )) w 1 for every k. Consider 
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FIG. 2: To get a better convergence for the free-energy, 
we considered the sequence 

f(m) (j _ Tc + T (m) j j nstead 

of / (m) (T) . As T c (m) -» T c for m -> oo, the two sequences 
have the same limit f(°°' (T) . Here we see that for cr = .1, 
/ (m) (T) has negative entropy s (m) (T) for T < T c (m) . 

the disorder-dependent density of states for a sam- 
ple a : Afg(E) = J^s $H k (s),E- The recursion re- 
lation that defines the model's Hamiltonian implies 
that when two samples a and b at the level k are 
merged to define a sample at the level k + 1, the 
resulting density of states N^. +1 {E) satisfies: 

M£ +l (0)= ME a ,E b ,e) (2) 

E = E a +E b + e 

where n k (E a ,E b ,e) = J2s u s 2 5 #2(Si),£ x 
x< 5f/ b (Si) b 6 ^e fc (Si,S e ),e i s the number of states in 
the composite system that have H a = E a , Hb = E b 
and interaction energy equal to e. For given E a and 
Eb, the joint distribution of the nk(E a ,Eb, e) for the 
different values of e is multinomial with parameters 
q € = (n k {E a ,E b ,e)) = Afg(E a )Af^(E b )^ k (e), while 
Ufe's with different first or second argument are 
independent. 

Our algorithmic approach starts from the exact 
iteration of Eq. [2] Thanks to the use of a discrete 
interaction energy, the iteration time grows with k 
proportionally to 2 k ( 3 ~ a \ This allowed us to reach 
the level k = 12. The results of the iteration shows 
that the values of the energy can be divided in bulk 
region of energy density around the origin where the 
number of states A4 (E) — e 2 Sk ^ E ^ 2 > is exponential 
in the system size, and an edge region where the 
number of states is of order one (see fig. [3]). 

In order to proceed further, we assume the ex- 
istence and self-averaging property of the entropy 
density 5(e) in the thermodynamic limit. We then 



coarse-grain our description. We discretize the en- 
ergy density in the bulk region and use an approxi- 
mated iteration for the entropy, where the sum ^ 
is approximated by its maximum term. We account 
for the edge region using the exact recursion for the 
No = 10,000 lowest energy levels. We can in this 
way iterate many times and obtain a good estimate 
of the thermodynamic limit behaviour. 

In fig. [3l we present the average entropy den- 
sity as a function of the energy density e for vari- 
ous values of a. In order to identify the transition, 
it is more convenient to average the data obtained 
with a fixed energy difference from the fluctuating 
ground states. We can get in this way good esti- 
mates of the value of the inverse critical tempera- 
ture of the model f3 c = s'(eo). An interesting fea- 
ture emerging from our analysis is that close to the 
ground state energy density eo the entropy is not an- 
alytic and behaves as 5(e) « (3 c (e — eo) + C(e — eo) a 
with a well fitted by the value a = 2 — a. This be- 
havior, when translated in the canonical formalism, 
implies a singularity of the free-energy close to T c , 
F(T) = E + Const x (T - T c )t^ , corresponding to 
a specific heat exponent a — —jzr^- 
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FIG. 3: The entropy s(e) vs e/^y for a = .9, .8, .7, .6 
(with 7 = 30,10,5,5 respectively), from the outside to 
the inside. Inset: power law behaviour of ft — /3 C . The 
slopes are close to 1 — a, with a = .6, .7, .8 from bottom 
to top. 

Having found evidence for a thermodynamic phase 
transition, we turn our attention to the distribution 
of low-lying energy states. The REM picture sug- 
gests that, close to the ground state, the number 
of energy levels with given energy E are indepen- 
dent Poissonian variables with density (Moo(E)) = 
e Pc(E-E ) _ a computation using extreme value 
statistics shows that the probability Qi(k) that the 
ground state and first £ — 1 excited states are occu- 



pied by n levels is given by: 

Qt(n) = (1 - exp(-f/3 c )) n /(^ c n). 



(3) 



In fig. |4] we show the Qe(n) obtained numerically 
together with a fit with the form This procedure 
confirms the validity of a REM-like transition, and 
provides an alternative way of estimating the critical 
temperature. As fig. [5] shows, the two estimates 
for different values of k tend to the same limit from 
opposite directions. 
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FIG. 4: Numerical data (cross) and the fitting function 
Q3(n) for the statistics of occupation of the ground state 
and the first two occupied levels. Here k = 10, a = 0.6 
and 7 = 5. The dashed line is a fit with the form (J3J) 
with /3 C = 1.20 




FIG. 5: Finite volume estimation of the inverse critical 
temperature, % /7/3c fc ' ) vs k, for a — 0.6 and 7 = 5 de- 
termined by Q (circle) and by /3 e = s'(eo) (triangles). 
The latter have been fitted with a function of the type 



/3 C — B C (solid line). The asymptotic value (3 C 



is given by the dashed line. 

Conclusions- In this letter we have introduced a 
hierarchical, non-mean field, REM. We have ana- 



lyzed it through small coupling series, through a 
1RSB replica Ansatz, and through an algorithmic 
approach. The two approaches point to the exis- 
tence of a REM-like phase transition at the temper- 
ature where the entropy vanishes. At variance with 
the mean field result (which predicts a discontinuity 
in the specific heat), one finds a non-trivial specific 
heat exponent at T c . It will be interesting to study 
the replica structure of this hierarchical REM in or- 
der to explore other possible replica solutions at low 
temperatures. Another important theme of future 
research is the study of spin-glass models with p- 
body interaction (13 , [lil [2fj | : at the mean field level, 
these models display an entropy crisis transition sim- 
ilar to the one of the REM whenever p > 3. It will 
be interesting to study them on hierarchical lattices. 
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